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Abstract 


We  introduce  a versatile  class  of  point  processes  on  the 
real  line,  which  are  closely  relafed  to  finite-state  Markov 
processes.  Many  relevant  probability  distributions,  moment  and 
correlation  formulas  are  given  in  forms  which  are  computationally 
tractable.  Several  point  processes,  such  as  renewal  processes  of 
phase  type,  Markov-modulated  Poisson  processes  and  certain  semi- 
Markov  point  processes  appear  as  particular  cases.  The 
treatment  of  a substantial  number  of  existing  probability  models 
can  be  generalized  in  a systematic  manner  to  a'^rival  processes 
of  the  type  discussed  in  this  paper. 

Several  qualitative  features  of  point  processes,  such  as 
certain  types  of  fluctuations,  grouping,  interruptions  and  the 
inhibition  of  arrivals  by  bunch  inputs  can  be  modelled  in  a way 
which  remains  computationally  tractable. 
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1 . Introduction 

While  the  general  theory  of  point  processes  on  the  real 
line  has  seen  major  developments  during  the  recent  years,  the 
cases  where  analytically  or  algorithmically  tractable  results 
are  obtained  remain  Intimately  related  to  an  underlying  Markovian 
assumption.  Stochastic  models  which  require  as  few  as  two 
general  renewal  processes  to  be  considered  are  In  most  cases 
Intractable.  Standard  constructions,  such  as  the  superposition 
of  two  renewal  processes,  destroy  the  regenerative  properties  to 
such  an  extent,  that  an  exact,  non-asymptotic  analysis  of  the 
model  becomes  very  difficult.  If  not  Impossible. 

This  problem  has  arisen  early  In  a variety  of  practical 
situations.  Notably  In  communications  engineering,  a variety  of 
techniques  have  been  developed  by  which  a complicated  point 
process  Is  replaced  by  a simpler  one.  The  latter  does  not  share 
the  complex  probability  structure  of  the  former,  but  exhibits 
certain  qualitative  features  of  It  and  a few  lower  order  moments 
can  usually  be  matched  by  adjustment  of  parameters,  so  thit  the 
two  processes  are  at  least  macroscopical ly  very  similar.  A 
survey  of  such  techniques  may  be  found  e.g.  In  L.  Kosten  [4\ 

In  this  paper,  we  shall  discuss  a versatile  class  of  point 
processes  which  Is  closely  related  to  finite  Markov  processes.  Its 
theoretical  analysis  is  therefore  elementary  and  Its  relation  to 
finite  systems  of  differential  equations  guarantees  that,  at  least 
for  a wide  range  of  parameter  values,  the  resulting  equations  may 
readily  be  solved  numerically. 

We  shall  give  a general  description  of  the  point  process  In 
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Section  3.  It  involves  a very  large  number  of  parameters,  but 
in  any  given  application  most  of  these  can  be  eliminated  or 
assigned  simple  values,  depending  on  the  qualitative  features  of 
the  point  process  which  the  user  wishes  to  bring  forth  in  the 
model . 

A crucial  underlying  notion  is  that  of  a probability 
distribution  of  phase  type  (PH-di stribution) , investigated  in 
[8-12].  The  next  section  reviews  the  definition  and  key  properties 
of  PH-distributions. 

2.  The  PH-distributions 

We  shall  only  review  the  continuous  PH-distributions  on  [0,»), 
bearing  in  mind  that  there  is  an  entirely  analogous  development 
for  discrete  PH-distributions,  derived  from  the  theory  of  finite 
Markov  chains.  All  the  definitions  and  derivations  in  this  paper 
may  therefore  be  modified  to  define  a point  process  on  the  discrete 
time  lattice. 

Consider  an  {m+l)-state  Markov  process  with  m transient  states 
and  one  absorbing  state.  Its  infinitesimal  generator  Q is  then  of 
the  form 


q 


T 

0 


(1) 


where  T is  an  mxm  matrix,  with  T^^<0,  ^or  iii*j  and  such  that 

T’  exists.  The  vector  T®  has  nonnegative  entries  and  satisfies 
Te+T®»0,  where  e*(l , . . . ,1 ) ' . A vector  (a,  ) of  initial 

probabilities  is  also  given  and  satisfies  ae+a|^^^»l, 

The  probability  distribution  F{*)  of  the  time  till  absorption 


in  the  state  m+1  is  then  given  by 
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F(x)*l-aexp(Tx)e,  for  x>0.  (2) 

The  pair  (a,T)  is  called  a representation  of  F(*)  and  any 
probability  distribution  F(*)  which  can  be  so  constructed  is  a 
PH-distribution.  In  this  paper,  we  may  assume  without  loss  of 
generality  that  so  that  F(*)  does  not  have  a jump  at  0. 

We  further  consider  the  matrices  T"  with  and  A®  with 

A®»diag(o^ . .ajjj) . The  Markov  process  with  the  infinitesimal 
generator 

Q*=T+T®A®,  (3) 

is  now  of  considerable  importance.  We  may  always  assume  that  C* 
is  irreducible,  if  necessary  after  deletion  of  superfluous  states 
from  the  chain  Q.  The  matrix  Q*  describes  the  Markov  chain, 
obtained  by  resetting  the  original  chain  instantaneously  using 
the  same  initial  probabilities,  whenever  an  absorption  into  the 
state  m+1  occurs. 

The  stationary  probability  vector  ^ of  Q*  is  obtained  by 
solving  the  equations  £Q*»0,  ite*1 . The  times  of  absorption  (and 
resetting)  are  readily  seen  to  form  a renewal  process  with  the 
underlying  probability  distribution  F(*)*  A renewal  process  in 
which  the  interrenewal  times  have  a PH-distribution  is  called 
a PH-renewal  process  [12]. 

We  refer  the  reader  to  the  cited  references  for  the  closure 

properties  of  the  class  of  PH-distribution.  For  use  in  the  sequel, 

we  need  the  following.  The  mean  of  the  distribution  F(*)  is 

pi  = -aT’^£,  and  the  probability  distribution  F*(x)  = (yl  )"V’^[1-F(u)]du, 
' ' 0 
x>0,  is  also  of  phase  type  and  its  representation  is  (i.T). 
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Moreover  the  stationary  version  of  a PH-renewal  process  is 
obtained  by  starting  the  Markov  process  Q*  with  the  initial 
probability  vector  w. 

Me  shall  now  use  the  Markov  chain  Q*  as  a substratum  for  the 
definition  of  the  point  process  of  interest.  A transition  from 
the  state  i to  the  state  j,  which  does  not  involve  a renewal 
(i.e.  no  visit  to  the  "instantaneous"  state  m+1)  will  be  called 
an  ( i ..i  )-transition.  We  recall  that  in  a Markov  process, 
transitions  from  a state  to  itself  are  not  considered,  so  that  we 
only  have  (i , j)-transitions  for  i/j.  A transition  from  i to  j, 
which  involves  a renewal,  will  be  called  an  ( i , j )-renewal  transition. 
Such  transitions  which,  rigorously  defined,  go  from  1 to  the 
instantaneous  state  m-M  and  thence  to  j,  may  go  from  a state  to 
itself.  Whenever  the  process  is  in  state  i at  time  t,  an  (1,j)- 
renewal  transition  occurs  with  the  elementary  probability  T^ojdt. 

3.  The  Point  Process 

For  reasons,  which  will  be  apparent  in  the  examples  of  applied 
interest,  we  shall  allow  each  of  the  events  in  the  process  to  be 
multiple  and  we  shall  use  the  intuitively  appealing  terminology  of 
group  arrivals.  There  are  three  different  types  of  arrival  epochs, 
for  which  we  now  define  appropriate  notation: 
a.  During  any  sojourn  time  of  the  Markov  process  Q*  in  the 
state  i,  l<i<m,  there  are  Poisson  arrivals  of  rate  and 
group  size  density  {p^(k),  k>0}.  We  shall  denote  the 
probability  generating  function  of  {p^(k)}  by  ♦^(z)  and  we 
may  assume  without  loss  of  generality  that  (|>^{0)*0,  for  lsi<m. 

If  there  are  no  arrivals  of  the  other  types,  the  doubly 
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stochastic  Poisson  process  [2]  so  obtained  is  called  the 
Markov-modulated  Poisson  process. 

b.  At  (i ,j)-renewal  transitions,  there  are  group  arrivals  with 

probability  density  {r^j(k),  k>0}.  The  generating  function 
of  the  density  {r^j(k)}  is  denoted  by  for  l<i,j<ffl. 

The  matrix  is  denoted  by  «(z)  and  we  do  allow 

♦jj(0)  to  be  positive  for  sjme  (i,j). 

c.  At  (i  ,j)-transitions,  there  are  group  arrivals  with 

probability  density  k>0}.  The  generating  function 

of  the  density  {q^j(k)}  is  denoted  by  y^j{z),  for  ij!*j.  We 
shall  fin'l  it  convenient  to  define  v^^(2)»l,  for  l<1<ro. 

The  matrix  is  denoted  by  ¥(2).  We  do  allow  some 

of  the  to  be  positive. 

We  now  make  the  following  independence  assumptions.  For  every 
t>0,  given  the  path  function  of  the  Markov  process  Q*,  the  epochs 
of  the  first  type  of  arrivals  are  conditionally  independent, 
given  the  successive  sojourn  times  and  behave  as  a homogeneous 
Poisson  process  on  every  sojourn  interval.  Given  the  times  and 
types  of  the  arrival  epochs  up  to  time  t,  the  group  sizes  are 
conditionally  independent  and  have  the  probability  densities, 
given  above. 

By  N(t)  and  J(t),  tzO,  we  denote  respectively  the  number  of 
arrivals  in  (0,t3  and  the  state  of  the  Markov  process  Q*.  It  is 
then  easy  to  see  that  the  process  {N(t).  J(t),  taO)  is  a Markov 
process  with  the  state  space  {kaO}x{l m}. 

The  probabilities  j {v,t)-P{N{ t)-v.  0(t)-J |N(0)-0,  0(0)«i} 
l<i,jim,  are  of  considerable  interest.  We  derive  a recursive 


<in  i«itj.MiJ.-g*yw? 
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system  of  differential  equations  for  the  matrices  P(v,t)» 
{P^j(v,t)},  for  v>0. 

The  Chapman-Kolmogorov  equations  for  the  process 
{N(t),  J(t),  tjfO}  may  be  written  as 

Pjj(v,t)-P^j(v,t)(Tjj-X^)+  r P^j(k,t)AjPj(v-l<)+  (4) 

k * 0 

h-1  k«0  h-1  k»0  p J nj 

hfj 

for  l<1»j<m  and  vjO.  In  matrix  notation,  we  have 

P'(v,t)-P(v,t)A{X)+  E P(k,t)A(X)A[£{v-k)]  (5) 

k-0  ” 

+ S P(k.t)CToq(v-k)]+  E P{k,t)[T‘‘A%r(v.k)3, 
k-0  k-0 

where  A(x.)*d1ag(x^ x^^),  A[£(T)]-diag{p^  (t) , . . . ,Pj^(t)) , for 

TiO.  The  matrix  q(T)  has  entries  q^jlt),  for  t^O  and  MJ,  but 
qil(T)-5^0»  ^0*^  "ftO*  matrix  rtr)  has  entries  r^jlt),  for  t>0. 
The  symbol  « denotes  the  Schur  or  entry-wise  product  of  two 
matrices. 

00 

The  matrix-generating  function  P(z,t)»  E P{v,t)z'*,  defined 

v-0 

for  |z|<l,  satisfies  the  differential  equation 


Iy  P{z.t)»P(z,t){-A(x)+A(x)A[jt(z)]+T«»'i'(z)+T"A"o#(z)},  (6) 

with  the  initial  condition  P(z,0)-I.  It  follows  that 

P{  :,t)  = exp{R(z)t} , (7) 

where  R(z)=a(x_)a[£(z  )]-A(x.)+Tof  (z)+T°A°o$(z) . 
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see  that  tn)..(„.E.  where  that  P„  .t).exp„.t) . 

•S  IS  to  be  expected,  rhe  explicit  expression  (y)  for  P(x.t) 
is  also  the  direct  generalization  of  the  forcul,  P(z.t).expt-»t(l.z)] 
for  the  ordinary  Poisson  process. 

A.  The  Mean  Matrix 

iy  differentiating  with  respect  to  z in  (7)  and  setting  z-l 
we  obtain  the  matrix  * 


«(t)-[iy  p(z.t)]  . r t" 

*-  n.1  KT 


nT  v»0 


n-1 


where 


R' (U*a(X(»x)+ToC+t*A®<»D,  ^ 

with  C-O'd-).  J„e  g., ■(,.). 

iie  Shan  first  compote  the  rector  t(t).M(t)e.  which  plays  an 
important  role  In  applications.  Fro™  (8)  we  obtain 


E(t)-  t t"  (l*"-'R'(l)e. 
n»l  n!  “ 

and  In  [12]  we  proved  that 

o» 

nn  nr'**  “o  '’''’*‘’*“*'*“*"‘*[i-exp(()*t)](T»j.Q*)-’, 

where  t*  Is  any  real  number  such  that  f>max(-q.,),  .„8  „ ,, 

mxm  stochastic  matrix  with  Identical  rows  given  by 
It  follows  that 


(10) 


(11) 


I ‘ 8 

iL(t)=y*et+(I-n)(T*n-Q*)"'K'  (l)e  + 

[n-exp{Q*t)](T*n-Q*)"^R'(l )e,  (12) 

where  y*=TrR'  (1  )e. 

We  see  that  Trii.(t)»y*t,  and  that  the  first  two  terms  in  (12) 
give  the  linear  asymptote  of  ]i_(t),  since  the  third  term  tends  to 
zero  as  t-^«.  It  is  advisable  therefore  to  compute  the  third  term 
separately.  Denoting  it  by  ^(t),  it  may  be  evaluated  by  solving 
the  system  of  differential  equations 

v' (t)=Q*v(t) , v(0)»(n-I)(T*n-Q*)"^R' (1 )e.  (13) 

It  should  be  emphasized  that  in  many  applications  of  the  present 
point  process,  the  approach  to  steady-state  is  slow. 

The  second  term  in  (12)  will  be  denoted  by  and  is  given  by 

v-(T*n-Q*)"^R'(l)e-y*T*''*e.  (14) 

The  linear  asymptote  of  EN(t)«oy(t),  corresponding  to  the 
case  where  the  PH-renewal  process  is  an  ordinary  PH-renewal 
process  is  clearly  given  by  y*t-y*T*"^+a(T*n-Q*)”^R' (1 )e. 

We  shall  now  discuss  the  computation  of  the  matrix  M(t)  and 
its  asymptotic  behavior.  It  readily  follows  from  Formula  (8),  that 

M' (t)-M(t)Q*=exp(Q*t)R' (1 ) , (15) 

with  M(0)«0,  so  that 

M(t)=/^^xp(Q*u)R'(l)exp[Q*(t-u)]du. 

0 


(16) 


9 

Adding  T*M(t)n=T*A[M(t)e]n,  to  both  sides  of  Equation  (15) 
and  evaluating  the  Laplace  transform  of  both  sides  of  the 
resulting  equation,  we  obtain 

M(s)«(sI-q*)'^R'(l  )(sI+T*ll-Q*)‘^+A[M(s)e3T*n(sI  + r*n-Q*)’\  (17) 

in  which  M(s)=/  e’  M(t)dt.  Since  we  know  from  the  theory  of 
0 

regenerative  processes,  that  lim  t”^M(t)  exists,  this  limit  may 

be  found  by  evaluating  lim  sM(s).  We  so  obtain 

s->0+ 

lim  t'^M(t)«u*T*n(T*n-Q*)”^»y*n.  (18) 

t-*-« 

By  considering  the  differential  equation  obtained  from  (15) 
for  the  matrix  M(t)-vi*nt,  we  obtain  the  constant  term  in  the 
asymptotic  formula  for  M(t),  since 

lim  [M(t)-y*nt]=nR' (1  )(T*n-Q*)'^-vi*T*“^n+A(v)n 

«nR'  (1  )(T*n-Q*)'U(T*n-Q*)'^R'  (1  )n-2y*T*"^n.  (19) 

It  follows  that 

M(t)=nR'(l)(T*n-Q*)’U(T*n-Q*)'^R'(l)n-2w*T*’^n+u*nt+o(l),  (20) 

as  t->®. 

In  computing  M(t)  numerically,  it  is  again  advisable  to  modify 
Equation  (15)  to  the  equation  for  the  difference  K(t)  between 
M(t)  and  its  linear  asymptote.  We  so  obtain 

K' (t)-K(t)Q*=exp(Q*t)R'(l )+nR ' (1 ) (T*n-Q* )"^Q^-w*n 


=[exp(Q*t)~n]R' (1 ) , 


(21) 
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where  K(0)  equals  minus  the  constant  term  !n  Formula  (20). 

B.  The  Second  Moment  Matrix 

By  differentiating  twice  with  respect  to  z in  Formula  (7) 
and  setting  z»l , we  obtain  the  second  factorial  moment. matrix 
M2(t),  wnich  is  given  by 

M„(t)«  E t'’  ”e^  q*''R’'(l)Q*""^"''  + 

^ n=l  nT  v=0 

2E  "e^  E Q*^R'{1)Q*''"''R'{1)Q*'’"^"''.  (22) 

n=2  n!  v=0  r»0 


The  matrix  M2(t)  can  be  discussed  in  an  entirely  analogous  manner 
as  the  matrix  M(t),  but  the  resulting  expressions  are  much  more 
involved.  We  shall  only  discuss  the  vector  which 

is  needed  in  the  computation  of  the  variance  of  the  number  of 
arrivals  in  (0,t). 

We  have 


1^2 


CO  . <0  n‘'2 

E t"  Q*"’'R"(l)e+2  E t"  E 
n»l  ^ n»2  nT  r»0 


Q*''R'(l)Q*"~^’’^R'(l)e.  (23) 


The  first  term  is  given  by 


p^te+[I-exp(Q*t)](T*n-Q*)"^R"(l)e, 


(24) 


where  u^*iR"(l)e,  by  application  of  Formula  (11). 

In  order  to  evaluate  the  second  term,  we  notice  that 

» n n 9 

E t"  E Q*'^R'(l)Q*”’^"'^(T*n-Q*) 
n«2  nT  r»0 

00  00  p * 2 

= T*  E t!^  Q*"’^R*(l)n-  E t^  E Q*’'R' (1  )Q*"'^’'' 
n=2  n!  n=2  n!  r=0 


ii 

=-M{t)+  Z 1^  Q*""^R‘(1)+t*  Z t^  Q*"“^R'(l)n. 
n*l  n!  n*2  nl 

By  repeated  application  of  Formula  (11),  we  obtain  that 

n 2 2 

z z q**"R'(i)Q*""^''’=-M(t)(T*n-Q*)“Uy*f-n 

n=2  n!  r*0  ^ 

+t(l-n)(T*n-Q*)‘^R'  (1  )ii+tnR*  (1  )(''*n-Q*)'^ 

+[I-exp(Q*t)]{(T*n-Q*)"^R'(l)(T*n-Q*)'^-(T*n-Q*)”2R'(l)n}. 

Upon  substitution  in  Formula  (23),  we  obtain 

ji2(t)--2M(t)(T*n-Q*)“^R'(l)e+u*^tVi*2^i  (25) 

+2tu*(I-n)(T*n-Q*)"^R'(l)e+2tnR'(l )(T*n.Q*)‘’R'(l)e 
+ [I-exp(Q*t)3{(T*n-Q*)'^R''(l)e-2y*(T*n-Q*)“^R'(l)e 
+2(T*n-Q*)’^R'(l)(T*ii-Q*)"^R'(1  )e} 

By  using  Formula  (20),  we  obtain  the  following  asymptotic 
expansion  for  ]j.2(^^  ** 

jm2( t)  = t^u*^e+t{w^e+2u*(T*il-Q*)*^ R'  (l)e-4y*^T*’^e 

+2[iR'(l)(T*n-Q*)'^R'{l)e]e}  (26) 

+4y*^T*‘^e-u|T*"U+(T*n-Q*)''^R"(l  )e 
-2[nR' (1 )(T*n-q*)’^R'(l )e]e-2y*T*"^(T*n-q*)“^R' (1  )e 
+2[(T*n-q)"^R'(l)]V2T*''^[lR'(l)(T*n-q*)"^R'(l)e3e 
-2y*{T*n-q*)‘^P.’(l)e-2y*T*'^(T*n-q*)’^R'(l  )e 
+0(1). 
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Me  also  have  that 

trP2(t)=p*^t^+p|t-2y*^T*"U+2tiirR'  (1  )(T*n-Q*)"^R'  (1  )e 

-2TrR'(l)[I-exp{Q*t)](T*lT-Q*)"^R'(l)e.  (27) 

Remarks 

Although  the  preceding  formulas  are  complicated,  they  are 
well-suited  for  numerical  computation,  as  they  Involve  a small 
number  of  vectors  which  need  to  be  evaluated  only  once.  In  the 
few  examples  where  these  coefficient  vectors  may  be  explicitly 
evaluated,  they  expand  Into  very  complicated  algebraic  functions 
of  the  moments  of  F(*)  and  the  group  size  densities.  We  shall 
Illustrate  this  below  by  an  example,  which  Is  of  particular  Interest. 

If  one  wishes  to  compute  the  vectors  jj.i{t)  and  £2^^^ 

Interval  [0,T],  It  is  advisable  to  Implement  a numerical  method 
for  the  solution  of  systems  of  differential  equations  to 
evaluate  the  three  Items  i!.i(t),  M(t)  and  ^2^t)  for  t"nA,  for 
successive  values  of  n and  for  a step  A.  In  this  manner  exp(Q*t) 
needs  to  be  evaluated  only  once  and  can  be  substituted  In  all  the 
formulas  where  It  occurs. 

It  is  also  worth  stressing  that  one  can  frequently  avoid 
computing  the  matrix  M{t).  In  order  e.g.  to  compute  the  variance 
time  curve  corresponding  to  the  ordinary  PH-renewal  process,  we 
need  to  evaluate  ay.(t)  and  av_2{t) , It  is  easy  to  see  that  the 
formula  for  aij_2(t)  only  involves  the  vector  z(t)°aM(t),  which  can 
be  computed  by  solving  the  differential  equations 

z' (t)-z(t)Q*=aexp(Q*t)R' (1 ) , 
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with  z(0)=0.  This  involves  far  fewer  arithmetic  operations  and 
less  storage  then  the  computation  of  M(t). 

From  the  mean  and  the  second  factorial  moments,  It  is  of 
course  a routine  matter  to  compute  the  variances. 

4.  Examples 

A.  The  Superposition  of  a Poisson  Process  and  a PH-renewal  Process 

Kuczura  [5]  considers  a queue  whose  input  process  is  the 
superposition  of  a Poisson  and  a renewal  process,  but  in  order 
to  obtain  tractable  transform  solutions  he  imposed  the  require- 
ment that  the  distribution  of  the  interrenewal  times  have  a 
rational  Laplace-Stiel tjes  transform.  This  is  only  slightly 
more  general  than  requiring  the  renewal  process  to  be  of  phase  type. 

We  believe  that  there  is  practical  merit  to  consider  queues, 
whose  arrival  process  is  the  superposition  of  a Poisson  process 
(background  input)  and  a PH-renewal  process  with  group  arrivals 
(burst  inputs).  Such  a process  corresponds  to  a given  matrix  T 
and  vector  o and  the  parameter  choices  (|>^(z)«'Z,  for  l<i<m, 

♦ (z)»p(z)E,  '»'(z)»E,  where  p(z)  is  the  probability  generating 
function  of  the  group  sizes  in  the  renewal  arrival  process. 

For  this  case,  we  shall  evaluate  the  coefficient  vectors 
which  appear  in  the  formulas  for  u^(t)  and  y2(t).  We  do  not 
recommend  that  these  explicit  formulas  be  used  in  numerical 
computations,  but  we  use  them  to  illustrate  the  complicated 
dependence  of  these  coefficient  vectors  on  the  moments  of  F(*)  and 
the  group  size  density.  By  particularizing  further  to  the  case 
of  an  ordinary  PH-renewal  process,  we  shall  also  be  able  to  check 
our  computations  against  known  formulas  for  the  asymptotic 
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variance  of  a renewal  process. 

We  obtain  the  particular  formulas: 


R'CD-Xl+n^T^A", 

R"(l)=n2T“A“, 

R'(l)e=xe+nir, 

£R ' ( 1 )®X£+rii uj  ^ci_» 
vi|=x+niP|*’^ , 


n^^p'd), 

n2=P"(l). 

R''(l)e=n2r 

jlR"  ( 1 )®n2Vi]  ”^2. 


(28) 


The  proof  of  the  following  three  formulas  requires  some  Interesting 
algebraic  manipulations  for  PH-dlstrlbutlons.  The  first  of  these 
formulas  Is  proved  below  and  the  other  two  follow  by  similar 
calculations. 


o(T*n-Q'‘ )’^=ir.T 

(T*n-Q*)''’T'''e»-T”V^2wJ 

/I  . .-1  *“1x1  .2  .“2 

-(2’'2^1  V2  *'1  ^ 


(T*’''+[yJyj“be, 

xl  . .-1a  t-1 

+^2'^i  * 

-'T-’e 

* - 1 1 , . " 1 \ o 


(29a) 

(29b) 


(29c) 


In  order  to  prove  (29a),  denote  the  left  hand  side  by  u^  and 

write 

(T*n-T-T‘’A“)u-r, 

or 

'r*(lli)*"TiL"(«yL)I“'I“ » 

which  leads  to 

u»T*(iru)T'‘^e+(l+au)e,  (30) 

since  T“^T®*-e.  Recalling  that  y^®-aT”^e,  premultiplication  by  a 
In  the  preceding  equation  leads  to  iu=y]”^T*'\ 
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Noting  that  -iT'^e  is  the  mean  of  F*(x)=vi,“V^[1-F(u)3du  I 

we  readily  obtain  that  i.T’^e=-|ii2iij"’^ . Premultiplication  by  v | 

in  (30)  then  yields  that  I 

l+au=yj"^  ) , 

and  Formula  (29a)  follows  upon  substitution. 

Routine,  but  tedious  calculations  now  yield  the  following 
explicit  expressions  for  coefficient  vectors  appearing  in 
Formula  (25).  | 

(x*n-Q*)”^R'  (1  )e=n^w]"^T’^e+[XT*“Uniyj“^  (T*"^+2-U2y -j )]e,  (31a)  | 

( 

i 

li.(t)  = (x+n^yj"^)t+n^yj’^Cl-exp(Q*t)]T'^e,  (31b)  ; 

M(t)(T*n-Q*)’^R' (l)e-niyJ’^M(t)T'’e  + 

[XT*“^+n^yj  (T*‘U|-u^y  )]j^(t) , (31c) 

(I-n)(T*n-Q*)”^R'(1)e»niyj”H’^e4nTU^yj"^e,  (31d) 

nR' (l)(T*n-Q*)“^R'(l  )e  • I 

i 

I 

{(x+n^uj  ^)(Xt*  ’ 

n^y|  ^ -^Xn^y^y] » (31#‘) 

(T*n-Q*)"^R''(l)e»n2yi"H"^e+n2yf  ^T*“^ly^pj'Me.  (31f) 

(T*^-Q*)■^R■(l)e-[XT*’^+n^yj”^*■^T*"^[y•wj‘b3e 
+n^y]'^  [-T"^e-^2^'.j'W’^e  - 
(fy2WT’^T*"^+|ii2^Ul'"^-^^Mj"^  )e3 , 


(31g) 


f 

i 
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2 

[(t*ii-Q*)~^R' (1  )]^e^*(AT*  ^ 

+ 2TiTPf  ^C-T"V|-V2i^l'^T“U 

! 

~'2^2^1  "^4^2  ^1  ”^3^1  '— •*  ■ (3'”/ 

Substitution  into  Formula  (25)  does  not  produce  any  sub- 
stantial cancellation  of  terms,  other  than  that  resulting  from 
[I-exp(Q*t)]e»0.  In  order  to  check  on  the  accuracy  of  our 
derivations  however,  we  substituted  the  expressions  (31)  into  the 
formula  for  iij.2(t)  and  obtained 

2 

iru2(t)  = (^+n^u|~^ ) t^+(r)2Mj"^+n^y2’^]"^-2ri^yj'^  )t 

,1  2 )2  i-4  1 2 I i-3  /i9\ 

Vl^2  ^1 

If  one  sets  l»  n2®0»  and  evaluates  the  variance  Var^[N(t)] 
of  N(t)  for  the  stationary  process,  one  obtains  in  terms  of  the 
central  moments  of  F(«)  that 

Varg[N(t)]  = (x+a^uj  "^ ) t+|-+^^u| 

which  is  in  agreement  with  Formula  (18),  p.  58  of  Cox  [1]. 

B.  The  Markov-Modulated  Poisson  Process 

If  't(z)  = 4'(z)  = E,  and  <ti^(z)=z,  for  l<i<m,  we  obtain  an 
interesting  example  of  a doubly  stochastic  Poisson  process,  which 
was  used  as  an  arrival  process  in  the  queueing  models,  discussed 
in  [6],  [13],  [14]  and  [15].  Since  in  this  case  R'(1)*A(^), 
and  R"(1)»0,  some  minor  simplifications  occur  in  \;he  general 
moment  formulas. 


«*HSPPPPiiPP!. 
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The  Markov-modulated  Poisson  process  can  be  used  to  model  a 
large  variety  of  qualitative  phenomena,  such  as  interruptions  in 
arrivals,  rush-hour  behavior  and  others.  Heffes  [3],  in  a 
telephone  engineering  model,  considered  the  interrupted  Poisson 
process  in  which  arrivals  occur  on  alternating,  exponentially 
distributed  intervals.  This  corresponds  to  the  particular  choice 


1 

Q 

Q 

0 

T « 

II 

0 

1—1 

0 -02 

CM 

t> 

a“(1 »0) » 


X^"X,  (j>^{2)«z,  X2«0,  «ji2(z)  arbitrary,  ♦(z)«f(z)' 


1 1 
1 1 


A more  general,  useful  situation  arises  if  we  define  an 
interrupted  Poisson  process  on  an  alternating  renewal  process  of 
phase  type.  Let  the  odd-and-even-numbered  Intervals  have  PH- 
distributions  F^(‘)  and  F2(*)  with  irreducible  representations 
(a^ , T^)  and  (£2,  T2)  of  dimensions  m^  and  m2  respectively,  then 
a natural  extension  of  the  preceding  example  is  given  by 


T,  T-AJ 

0 

T » 

. 1“  “ 

0 Tj 

T® 

-2 

x^=x,  x^^O, 

(<i^{z)=z,  for  Isism^,  arbitrary  for  m-i+lsism^+mg. 

#(z)=y(z)=»E,  with  E^j»l. 

In  the  expression  for  T,  the  square  matrices  T^  and  T2  are 
of  orders  m^  and  m2  respectively,  ApA(o2)  and  T|  is  an  m^xm2 
matrix,  with  all  its  columns  equal  to  T^.  It  is  easily  verified 


,» Tteji^a,  *t 
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that  the  matrix  Q*,  which  is  given 
T T®A* 

Q*= 

T^A*  T 

‘2''l  '2 

has  the  stationary  probability  vector 

l*[yj  t PgCiij+wp’^jLg^  • 

where  Is  the  mean  of  l(=l,2,  and  £1^  is  given  by 

-k-*^  ’ k»l,2. 

Alternating  periods  of  rush  and  slack  arrivals  can  of  course 
be  modelled  by  other  choices  of  the  -parameters , 

C.  The  Markov  Arrival  Process 


If  ^=0,  ♦(2)«zE,  and  y^j(2)«2,  for  ifj,  we  obtain  a 
particular  semi-Markovian  arrival  process  in  which  the  underlying 
Markov  renewal  process  is  a Markov  process. 

By  suitably  enlarging  the  state  space,  any  semi-Markov 
arrival  process  in  which  the  sojourn  time  distributions  are  of 
phase  type  can  in  fact  be  obtained  as  a particular  case  of  our 
process  by  allowing  arrivals  at  some  (i ,j)-transitions  and  not  at 
others.  This  is  however  rarely  of  practical  interest  in  view  of 
the  high  order  of  the  Q*-matrix,  usually  required  by  this 
constructi on. 

D.  Arrivals  Inhibited  or  Stimulated  by  Renewals 

Prof.  E.  Gelenbe  renewed  our  interest  in  the  point  processes, 
discussed  here,  by  describing  practical  queueing  situations  in 
which  e.g.  substantial  group  arrivals  at  renewal  epochs  inhibit 


mfmm  sJB!iii!W)Jwy,Mi!  PPPWWI^iWMWiWi^PWWi 
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background  arrivals  for  a certain  length  of  time  after  their 
arrival.  Although  there  are  a variety  of  ways  of  modelling  input 
sequences  of  this  type,  it  is  not  easy  to  do  so  in  an  analytically 
or  computationally  tractable  way.  We  can  easily  choose  particular 
cases  of  the  present  point  process  which  can  serve  as  tractable 
qual i tative  models  for  such  arrival  streams. 

A PH-distribution  will  be  called  progressive,  if  it  has  a 
representation  (o,T)  in  which  the  matrix  T is  upper  triangular. 

It  is  easy  to  see  that  a PH-distribution  is  progressive  if  and  only 
if  it  is  a finite  mixture  of  generalized  Erlang  distributions. 

Every  path  function  of  the  Markov  process  Q is  then  non-decreasing. 
We  can  allow  e.g.  group  arrivals  at  some  or  all  of  the  (i,j)- 
renewal  transitions  and  select  the  A^-parameters  of  the  states 
close  to  renewals  so  as  to  model  the  inhibitory  effect  of  the 
group  arrivals. 

Although  the  statistical  problems,  related  to  fitting  such 
models  to  observational  data,  require  much  further  research,  the 
ease  with  which  the  mean  and  variance  time  curves  can  be 
computed  for  the  point  processes  discussed  here  should  be  useful 
in  fitting  sample  mean  and  variance  curves.  Computer  graphical 
methods  appear  to  be  very  promising  for  such  purpose  and  are 
currently  being  investigated. 

5.  The  Covariance  Structure 

In  this  section  we  consider  the  covariance  of  the  random 
variables  N(t)  and  N(t+t^+t' )-N(t+t^ ) , where  t>0,  ti>0,  t'>0,  for 


stationary  version  of  the  underlying  PH-renewal  process.  For 
the  non-stationary  version  similar,  but  more  complicated  formulas. 


•fji 
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are  routinely  obtained. 

Me  readily  see  that 

N(t)  N(t+t,+t')-N(t+t,) 

E{z^  Zg  ' ' lCa(t+t^+t')=j]|J(0)=i}, 

is  given  by  the  (i,j)-entry  of  the  matrix 

exp[R{z^ )t]exp(Q*t^ )exp[R(z2)t‘]. 

Differentiating  with  respect  to  z^  and  with  respect  to  Zg. 
setting  z^azg*!,  we  readily  see  that  the  covariance  of  N{t)  and 
N(t+t^+t' )-N(t+t^ ) is  given  in  the  stationary  case  by 

Cov-irM{t)exp{Q*t^)M{f)e-y*tf.  (34) 

Since  M(t' )e'*u(t' ) is  given  by  Formula  (12)  and 

TT^M  ( t ) »y*t£-lJ*T*  ^£+£R  * { 1 ) ( T*JI-Q*  ) ^ 

+nR'(l)[n-exp(Q*t)](T*n-Q*)'\  (35) 

and  using  the  fact  that  (T*n-Q*)'’^  and  exp(Q*u)  commute,  we  obtain 
after  routine  calculations  that 

CovnR'  (1  )[I-exp(Q*t)]exp(Q*t^)[l.exp(Q*t’  )](T*n-Q*)"^R'  (1  )e.  (36) 

For  the  particular  case  of  Example  A,  we  obtain  by  applying 
Formula  (31g)  that 

Cov«-niyj’^a[I-exp(Q*t)]exp(Q*t,)Cl-exp(Q*f).l(T"V^2H‘^^’^i)- 

We  see  that  the  numerical  computation  of  the  covariance  is  again 
reduced  to  the  solution  of  simple  systems  of  differential  equations. 
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